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Long  Term  Goals/Project  Objectives 


Investigate  propositions  of  the  Structural  Model  of  Team 
Collaboration  including  the  macro-cognitive  processes 


Examine  processes  related  to  knowledge  building, 
knowledge  interoperability,  and  shared  understanding 
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Long  Term  Goals/Project  Objectives 


Develop  and  investigate  the  Collaborative  and  Meaning 
Analysis  Process  (C-MAP)  based  on  a  foundation  of 
team  cognition  research 


Develop  process  measures  of  team  cognition  and 
collaboration 


Develop  a  scientific  basis  for  building  supporting 
technologies  for  collaboration  and  knowledge  building 
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Project  Objectives 
Initial  Experiment 


Obtain  and  establish  a  laboratory  task 

Noncombatant  Evacuation  Operation 

(time  pressure,  cognitive  overload,  unique  roles,  heterogeneous  knowledge) 

Develop  the  Collaboration  &  Meaning  Analysis  Proeess 
(C-MAP) 


Develop  measures  of  cognition  and  meaning  sharing 

(e.g.,  knowledge  interoperability,  shared  understanding) 


Conduct  study 


Organizational 


Joan  R.  Rentsch,  Ph.D. 


Research 

Laboratory 


Research  Questions:  Background 


C-MAP  is  relevant  to  red  items 


STRUCTURAL  MODEL  OF  TEAM  COLLABORATION 


Problem  Area 
Characteristics 


Collaborative  Situation 


Parameters: 


I  time  pressure 


'  information/knowledge 
uncertainty 

'  dynamic  information 


rge  amount  of  knowiedge 
(cognitive  overload) 


■  human-agent  interface 
complexity 

Team  Types 


[ 


culturally  diverse 


heterogeneous  knowledge 
unique  roles, 


*  command  structure 
(hierarchical  vs.  flat) 

*  rotating  team  members 
Operational  Tasks 


;  team  decision  making,  COA 
selection 

[develop  shared  understanding 

'intelligence  analysis 
(team  data  processing) 


Team 
Knowledge 
Base 

Construction 


v: 


Collaboration  Stases 


Collaborative 
Team  Problem 
Solving 


Team 
Consensus 


Collaboration 

Complete 


Outcome 
Evaluation 
and  Revision 


T 


Yes 


'  Achieve' 
V  Goal  / 


No 


Meta-Cognitive: 


•  individual  understanding  of 

problem  conditions 

•  individual  mental  model  developme 
of  situational  significance 

Information.  Processing.; . 

•  goal  development 

•  team  mental  model  of  problem 
*'■  •  team  plan  to  solve  problem 

•  track  team's  mental  model  changes 

•  understanding  remaining  items  to 
resolve 

•  compare  problem  solution  : 
against  goals 

•  problem  identification 

•  understanding  problem  task 

•  establish  team  communication 
and  trust 

•  establish  data  filtering  methods 

•  establish  meaning  transfer  conventic 

•  goal  definition 

•  iterative  information  collection 
&  analysis 

•  develop,  rationalize,  &  visualize 
solution  alternatives 

ns 

•  team  negotiation  of  solution 
alternatives 

•  analyze,  revise  output 

•Knowledge  Building: 

•  problem  definition 

•  individual  task  knowledge 

•  individual  team  knowledge 

•  team  mental  model  of  team 

•  team  task  knowledge 

•  domain  expertise 

•  shared  understanding 

•  collaborative  knowledge 

•  collaborative  knowledge 

•  shared  understanding 

•  goal  requirements 

•  exit  criteria 

Commnnication  Mechanism  for  Information  Processing  and  Knowledge  Bnilding  (applies  to  all  stages): 


'  presenting  individual  information 
'  disagreement 
'  questioning 


'  discussing  individual  information 
'  negotiating  perspectives 
'  discussion  of  possible  solutions 


•  discussing  team  generated  information 

•  providing  rationale  for  individual  solutions 

•  agreement 


Research  Questions:  Background 


Team  Member  Sehema  Similarity  (TMSS) 
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Research  Questions:  Background 


Team  Member  Schema  Similarity  (TMSS) 
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Research  Questions:  Background 


Team  Member  Sehema  Congruence 


Congruence  =  A  match  between  team  members’ 

schemas  in  content  and/or  structure 
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Team  Member  Schema  Similarity  Model 


Rentsch  &  Hall  (1994) 
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Research  Questions:  Background 


Collaboration  &  Meaning  Analysis  Process 

(C-MAP) 


Based  on  schema  communication  processes 

Externalizing  knowing  &  understanding 

Articulation  of  underlying  understanding 

&  meaning  formation 
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Research  Questions 


Hypotheses  were  generated  based  on  TMSS 
research  and  on  the  Structural  Model  of  Team 
Collaboration 

Knowledge  building,  knowledge  interoperability, 
shared  understanding  related  to  high  team 
functioning 
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Research  Questions 


Hypothesis  1 :  Teams  using  the  C-MAP  will  have 
higher  knowledge  interoperability  than  teams  not 
using  this  process. 

Hypothesis  2:  Teams  using  the  C-MAP  will  have 
more  congruent  knowledge  structures  than  teams 
not  using  this  process. 
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Research  Questions 


Hypothesis  3:  Teams  using  the  C-MAP  will  have 
higher  levels  of  performance  than  teams  not  using 
this  process. 

Hypothesis  4;  Knowledge  interoperability  and 
congruent  knowledge  structures  will  predict  team 
performance. 
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Initial  Experiment 


Sample 

147  UT  college  students  randomly  assigned  to 
49  teams  of  3  members 

Task 

NEO 

-  conducted  an  analysis  of  the  task 

-  2  pilot  teams  to  learn  about  task 
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Lab  Layout 


Workstation 


Workstation 
with  Computer 

Discussion 

Table 

Information 

Board 


Quad  Monitor 
and  TV/VCR 


Organizational 


Joan  R.  Rentsch,  Ph.D. 


Research 

Laboratory 


Initial  Experiment 


Initial  Experiment 


C-MAP  Manipulation 

•  Training 

•  Role  blurb 

•  Prompts 

•  Information  Board  (posted  &  structured  knowledge) 
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Sample  C-MAP  Prompts 


What  do  you  know  that  your  teammates  must  know? 
TELL  WHAT 


What  do  your  teammates  know  that  you  must  know? 

ASK  WHAT 


How  are  pieces  of  information  related? 
TELL  CONNECTLONS 


How  do  your  teammates  believe  pieces  of  information  are  related? 

ASK  for  CONNECTLONS 
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C-MAP  Interactive  Example 


3oto 
321  V/est  Street 

and  rents  it  out  I 

for  parties  and 
other  events. 


vjcty  Jjtreet 

parties  and  is 
living  in  his 
loft  on  West  Street. 


There  was  a  fire 
last  night  that 
destroyed  several 
properties  on 

Gay  Street 
from  590  to  660. 


There  i^^^T^hie 

avariah 


tnnsio 


nice 


We  need  to  find 
a  new  location!! 


can  hire 
Djf 


The  party  is  an 

'~]agement  party 
I  Betty  and  Joe 
who  hate 
fance  music. 


is  a  good 

3,e,swiihngioJ3' 

country  ntusw. 


Initial  Experiment 


ASK:  Part  I 

Knowledge  Reeall 


2 

High  tide  is  from  7am-9am  and  8pm- 10pm 

6 

The  CH-53  has  a  range  of  500  miles 

4 

It  takes  a  SEAL  team  45  minutes  to  get  from  the  shore  to  the  ehureh 

7 

A  SEAL  team  eonsists  of  7  people 

1 

Zodiaes  have  a  speed  of  1 5  miles  per  hour 

10 

A  SEAL  or  Army  team  ean  paraehute  from  a  C-130 

5 

The  CH-53  eannot  fly  in  fog 

8 

The  USS  Enterprise  is  200  miles  from  the  ehureh 

3 

High  tide  is  about  2  feet 

9 

Helieopters  ean  be  heard  within  5  miles 
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ASK:  Part  I 

Knowledge  Reeall 


INFO  RECALL  LIST 

High  tide  is  from 
7am-9am 
and  8pm- 10pm 

The  CH-53  has 
a  range  of 

500  mi 

High  tide  is  from  7am-9am 
and  8pm- 10pm 

The  CH-53  has  a  range  of  500  mi 

SEALS  = 

45  minutes 

L  shore  to  ehureh 

Zodiaes  have  a 

speed  of  1 5  mph 

It  takes  a  SEAL  team  45  minutes 

to  get  from  shore  to  ehureh  ■ 

Zodiaes  have  a  speed  of  15  mph  | 

^  The  CH-53 
eannot  fly  in  fog 

High  tide  is 

about  2  feet 

The  CH-53  eannot  fly  in  fog 

High  tide  is  about  2  feet 

A  SEAL  team  has  7  people 

A  SEAL  team 

has  7  people 

Enterprise  is 

200  miles 

from  ehureh 

- ^ ’ 

Enterprise  is  200  mi  from  ehureh 
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ASK:  Part  II 

Sorting  and  Labeling 


Tide  travel 


Enterprise  is 
200  miles 


Tom  ehureh 


SEAL  team 


Enterprise  distance 
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ASK:  Part  II 
Sorting  and  Labeling 

ASK:  Part  II 

Sorting  and  Labeling 


TTicrli  1^  -ft-zAni _ 

_ ^7 _ 

7  am- 
aiid  8pi 

Higli  tide  IS 
about  2  teet 

liacs  have  a 
d  of  1 5  mpli 

SEAL  team 


A  SEAL  team 
has  7  people 


1LS  = 
unites 
a  diiircli 


CH-53  Specs 

The  CH-53 
a  range  o 

500  nil 

^ 

Enterprise  distance 

The  CH-53 

cannot  flv  m  fos 

Enteipinse  is 

200  miles 

hom  church 

!,  Pk.D. 


(.y  rganizMional 
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ASK:  Part  II 

Similarity  Ratings 


Rate  how  similar  the  groups  are  on  a  seale  from 
-5  (Very  Dissimilar)  to  +5  (Very  Similar) 


Tide  travel 

SEAL  team 

0 

CH-53  Specs 

3 

-3 

Enterprise  Distance 

2 

-4 

3 

Tide  travel 

SEAL  team 

CH-53  Specs 

Enterprise  Distance 
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Initial  Experiment 

Measures 

Congruent  Knowledge  Structures  - 

Adaptive  Structured  Knowledge  (ASK) 
Assessment 

Knowledge  Interoperability  -  75  items  (based  on  task  analysis) 

Team  Process  -  2  raters  coded  5-minute  segments 

tell/ask  what,  tell/ask  why,  tell/ask  agreement, 
tell/ask  connections 

Team  Performance  -  2  raters  scored  Final  Plans 
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Initial  Experiment 


Pilot  teams  (n  =  6) 

Refined  instructions,  technology, 
C-MAP  manipulation 


Preliminary  Results 

Random  assignment  confirmed 

(e.g.,  no  differences  between  conditions  for 
gender,  familiarity,  cognitive  ability) 
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Initial  Experiment’s  Results 


Hypothesis  1;  Teams  using  the  C-MAP 
will  have  higher  knowledge  interoperability 
than  teams  not  using  this  process. 
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Initial  Experiment’s  Results 


Knowledge  Interoperability  t  =  2.28 


51 


50 

O 

^  49 

H 

^  48 

a 

47 

a 

o 

<u 

5  46 

a> 

OX) 

■C 

a  45 

o 


44 


43 


Control 


C-MAP 


Condition 
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Knowledge  Interoperability  Test  Score 


Initial  Experiment’s  Results 


Own  Role  Knowledge  t  =  1.99,/?  =  .054 

Other  Role  Knowledge  t  =  2.06* 


□  Control 
■  CMAP 


Source  of  Knowledge 
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Initial  Experiment’s  Results 


Hypothesis  2:  Teams  using  the  C-MAP  will  have 

more  eongment  knowledge  structures 
than  teams  not  using  this  process. 
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Congruence  of  Knowledge  Structure 


Initial  Experiment’s  Results 


Congruence  of  Knowledge  Structure  t  =  2.09* 

0.84 

0.82 

0.8 

0.78 

0.76 

0.74 

0.72 

0.7 


Control  C-MAP 

Condition 


Organizational 


Joan  R.  Rentsch,  Ph.D. 


Research 

Laboratory 


Initial  Experiment’s  Results 


Hypothesis  3:  Teams  using  the  C-MAP 

will  have  higher  levels  of  performanee 
than  teams  not  using  this  process. 
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Transportation  Scon 


Initial  Experiment’s  Results 


Transportation  Score  r  =  .28* 


14 


13.5 


13 


12.5 


12 


11.5 


11 


10.5 


Control  C-MAP 


Condition 
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Initial  Experiment’s  Results 


Hypothesis  4;  Knowledge  interoperability  and 

eongruent  knowledge  structures  will 
predict  team  performance. 


No  significant  results  for  congruent  knowledge  structures 
Other  Role  Knowledge  and  Transportation  Score  r  =  .30* 
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Team  Process  Behaviors 


Initial  Experiment’s  Results 


C-MAP  associated  with  improved  Team  Process  t  =  2.41  * 

60 

50 

40 

30 

20 

10 

0 


Control  C-MAP 

Condition 
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Initial  Experiment’s  Results 


Ask  ?  =  .03* 

Connections  t  =  .0 1  * 


Ask  Connections 


Communications 
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Initial  Experiment’s  Results 


Tell  connections  t  =  2 . 73  * 


Tell  What 


Tell  Why 


Tell  Connections 


Tell  Agreement 


□  Control 
■  C-MAP 
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Frequency 


Initial  Experiment’s  Results 


Ask  What 


Ask  Why 


Ask  Connections 


Ask  Agreement 
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Next  Project’s  Objectives  &  Approach 


Expand  lab  to  6  networked  computers  &  Ewall  interface 
Develop  experimental  stimuli  &  materials 
Conduct  a  study  using  distributed  teams 
Improve  measures  (process  measure),  stimuli,  &  design 
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Technical  Contributions 


Adaptive  Structured  Knowledge  (ASK)  T ool 

The  C-MAP  can  be  encoded  into  technology  designed  to 
facilitate  team  functioning  and  performance  based  on 
the  ACE-IT  model 
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C-MAP  Contribution  to  Collaboration  Technology 


Collaborative  behavior  was  affected  by 
knowledge  extemalization  &  prompting,  which 
can  be  built  into  support  technologies 


Knowledge  interoperability  was  affected  by 
knowledge  extemalization  &  prompting,  which 
can  be  built  into  support  technologies 
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C-MAP  Contribution  to  Collaboration  Technology 


C-MAP  as  scientifically  based  foundation  for  building 
support  technology 

•  Extemalization  of  knowledge  structures/schemata 

•  Prompting  transfer  and  development  of  knowledge 

•  Increasing  knowledge  interoperability 

•  Increasing  shared  understanding 

•  Increasing  team  member  schema  similarity 
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Advanced  Cognitive  Engineered 
Intervention  Teehnologies  (ACE-IT) 
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Advanced  Cognitive  Engineered 

TM 

Intervention  Technologies  (ACE-IT) 


Preliminary  pilot  test  indieates  T.E.A.M.s 
embedded  in  software  improved  team 
performanee  on  a  simulated  military  task 


Rentsch  &  Hutchison  (1999) 
Organizational  Research  Group 
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Expected  Final  Products 


C-MAP  as  a  scientifically-based 
foundation  for  building 
support  technology 


The  C-MAP  research  program  will  contribute  to: 


The  development  of 
methods  for 
representation  and 
transfer  of  meaning 


The  understanding  of 
the  processes  of  team 
cognition 
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Potential  Impact 


Influence  the  development  of  support  technology 

Provide  empirically  tested,  theoretically  derived 
hypotheses  to  shared  understanding  research 

Contribute  methodological  innovations 


Contribute  to  the  understanding  and  measurement  of 
the  development  of  congruent  knowledge  structures 
and  contribute  to  testing  the  Structural  Model  of 
Team  Collaboration 
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Planned  Publications 


Expect  to  present  this  study  at  a  conference 

Expect  to  prepare  a  manuscript  for  submission  to 
journal  based  on  this  study 

Master’s  thesis  based,  in  part,  on  these  data 
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